Slow relaxation in the Ising model on a small-world network 
with strong long-range interactions 
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We consider the Ising model on a small- world network, where the long-range interaction strength 
J2 is in general different from the local interaction strength Ji , and examine its relaxation behaviors 
as well as phase transitions. As J2/J1 is raised from zero, the critical temperature also increases, 
manifesting contributions of long-range interactions to ordering. However, it becomes saturated 
eventually at large values of J2 / Ji and the system is found to display very slow relaxation, revealing 
that ordering dynamics is inhibited rather than facilitated by strong long-range interactions. To 
circumvent this problem, we propose a modified updating algorithm in Monte Carlo simulations, 
assisting the system to reach equilibrium quickly. 



PACS numbers: 89.75.Hc, 



i.75.-k, 75.10.Hk 



When random links are added to a regular lattice, the 
latter becomes a small-world network, characterized by 
short path length and high clustering iJI • In such a 
small-world network, the diameter increases very slowly 
with the system size: / ~ logiV, while a regular one dis- 
plays / ~ 0{N). Also having common neighbors for two 
connected nodes is highly probable. With these features, 
all elements on the network can exchange information 
with each other more efficiently than on a regular lat- 
tice. Accordingly, it is expected that dynamical systems 
on small-world networks may display enhanced perfor- 
mance; examples include ordering in spin models 
synchronization in coupled oscillators 5], and computa- 
tional performance of neural network 6]. 

A small-world network, constructed from a one- 
dimensional lattice, has two kinds of connections: (short- 
range) local links and (long-range) shortcuts. It is con- 
ceivable that the two kinds of couplings in a real system 
have different origins and thus different strengths; this 
makes it desirable to examine the general case that in- 
teractions via local links and via shortcuts are different 
in strength. It is obvious that in the absence of long- 
range interactions (via shortcuts), long-range order does 
not emerge. As a small amount of weak long-range inter- 
actions is introduced, however, the system undergoes a 
phase transition to the state with long-range order. This 
indicates the importance of shortcuts in ordering, and it 
is of interest to elucidate how much they are important, 
relative to local links. On the contrary, without neighbor 
(local) interactions, the system cannot percolate below a 
certain value of connectivity. Therefore, we conclude that 
high clustering due to local interactions is also important 
for achieving long-range order. 

To probe the roles of long- and short-range interactions 
in ordering, we consider the Ising model as a prototype 
system exhibiting an order-disorder transition, and ex- 
amine the transition behavior on a small-world network, 
varying the long-range interaction strength J2 relative to 
the short-range strength Ji. When J2 = 0, the system 
reduces to the one-dimensional Ising model and does not 



display long-range order. In the case of uniform interac- 
tion (Ji = J2), the system is known to undergo a phase 
transition of the mean- field type [lllli. It is expected 
that the mean-field transition is prevalent for all finite 
values of J2/J1 as long as shortcuts account for a finite 
fraction of total links. Shortcuts in general assist spins 
to order, which is reflected by the increase of the critical 
temperature; similar trends have been found in analytical 
studies of slightly different systems in equilibrium 9, 10]. 

This work focuses on how the system approaches equi- 
librium, and reveals that strong long-range interactions 
( J2/J1 ^ 1) gives rise to extremely slow relaxation, mak- 
ing Monte Carlo (MC) dynamics based on the Metropolis 
algorithm inefficient. To avoid such slow convergence, we 
devise a modified updating algorithm, which assists the 
system to reach equilibrium more quickly. In the limit- 
ing case that Ji = 0, namely, all nearest-neighbor inter- 
actions are deleted, the remaining links (shortcuts) con- 
stitute a random network with connectivity kP, where k 
denotes the range of local interaction in the underlying 
lattice and P is the probability of adding or re-wiring 
shortcuts on each local link. 

Here the small- world network is constructed in the fol- 
lowing way: We first consider a one-dimensional (ID) lat- 
tice of N nodes, each of which is connected to its 2k near- 
est neighbors, with k being the local interaction range. 
Then each local edge is visited once and a random long- 
range connection (shortcut) is added with probability P 
(without removing the local edge). Note the difference 
from the original Watts and Strogatz (WS) construc- 
tion 0, where local edges are removed and reconnected 
to randomly chosen nodes. 

The Hamiltonian for the Ising model on a small-world 
network with such two kinds of interactions is given by 

k 

iJ = -Jl ^^(7i(7i+j - J2 ^ O-iCTj, (1) 

* J=i ihj) 

where ai (= ±1) is the Ising spin on node i of the network. 
The first term is precisely the Hamiltonian for ID Ising 
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FIG. 1: Erratic behavior of the order parameter with tem- 
perature T/Ji (with the Boltzman constant fcs = 1) for 
J2/J1 ~ 10 and P = 0.1. The magnetization m has been 
obtained from the average over 5 x 10'* MC steps after the 
data during initial 5 x 10* MC steps discarded. Data, labeled 
by five symbols, represent the results of five MC runs, respec- 
tively, on a single small-world network. The magnetization at 
low temperatures varies largely run by run, and the system 
persists to remain in the disordered state. 



model with fc-nearest neighbors whereas the second one 
describes the contributions of spin pairs connected via 
long-range connections. 

We perform extensive MC simulations at various val- 
ues of the addition probability P and the coupling ratio 
J1I J\. Specifically, we anneal the system, starting from 
disordered states at high temperatures, and employ the 
standard Metropolis algorithm with single-spin flip up- 
dating to compute various quantities including the order 
parameter (magnetization). As well known, this method 
is expected to have the system reach efhciently the equi- 
librium, characterized by the Boltzman distribution, and 
to give reliable results at all temperatures except in the 
critical region, where critical slowing down is unavoid- 
able due to strong fluctuations . Obtained are results 
which in general support the mean-field transition and 
saturation of the critical temperature, unless long-range 
interactions arc far stronger than local ones. 

On the other hand, for J2 much larger than Ji, the 
order parameter (magnetization) m turns out to change 
erratically around the critical temperature and the or- 
dered phase is hardly observed at very low temperatures. 
Furthermore, at low temperatures it varies largely MC 
run by run, even though a single small-world network 
configuration is used (see Fig. ^ for J2/J1 — 10 and 
P = 0.1; for convenience, the Boltzman constant fc^ is 
set equal to unity throughout this paper). Namely, the 
result depends upon the random number sequence. This 
may be explained in the following way: At high temper- 
atures, all spins can flip easily and the system is in the 
fully disordered state. On a small-world network, there 
appear clusters which are connected by shortcuts with 



the interaction strength far larger than the local (nearest 
neighbor) one. As the temperature is lowered, spins on 
such clusters align first along either the up- or the down- 
direction while other spins on the ID chain flip easily be- 
cause thermal fluctuations are still strong compared with 
local interactions. For the whole spins to be aligned be- 
low the critical temperature, all clusters should have the 
same spin orientation; otherwise some spins (which do 
not have long-range interactions) may confuse between 
spin clusters of different spin directions. However, it is 
not probable for a spin in the cluster to have opposite 
directions, due to the strong long-range interactions at 
such low temperatures. This yields low acceptance ratios 
in the algorithm, resulting in extremely long relaxation 
time. Accordingly, the system tends to remain in a dis- 
ordered state which does not correspond to the minimum 
of the free energy, even if the temperature is lower than 
the critical temperature. Finally, at very low tempera- 
tures, spins seldom flip, so that the value of the order 
parameter depends on the previous history. 

We examine relaxation of the order parameter, starting 
from the fully ordered state near the critical temperature 
Tc and from the disordered state at low temperatures, to 
measure the characteristic time scale for the system to 
reach equilibrium. Assuming the exponential relaxation 
in the form |rn — rriegl ^ eT^I'^ ^ we estimate the value of 
T, varying J2/J1 and P. Figure 13 shows the relaxation 
time T, measured in units of the MC step, in the system of 
size N — 6400, (nominally) at the critical temperature. 
It is observed that r grows exponentially from 10^ to 
10^ as J2/J1 is increased. For given value of J2/J1, r 
is shown to depend algebraically on P: r ~ P~'^ . We 
stress that these features are not restricted merely to the 
region near the critical temperature; they persist at all 
temperatures below the critical temperature, as shown 
in Fig. Ul In fact they are even more conspicuous at low 
temperatures] this manifests the sharp contrast with the 
conventional critical slowing down, present only near the 
critical temperature in systems on regular lattices . 

One can understand the exponential growth of r in 
terms of the inverse updating probability. For large val- 
ues of J2/ Ji, flipping one spin in a pair which interact 
strongly with each other will give much influence to the 
relaxation process. The probability of this update is 
given by e"'^^/^ at temperature T, where the energy 
change /S.E = J2 — cJi depends on the neighboring spin 
states through integer c. Since the temperature is mea- 
sured in units of Ji , the inverse of the updating probabil- 
ity leads to the relaxation time in the form t ~ gO-Ji/Ji ^ 
where a is a constant. On the other hand, as the link ad- 
dition probability P is increased, the characteristic path 
length I of the system in general reduces in an algebraic 
way ; this allows information to travel more efRciently 
and thus gives rise to the algebraic decrease of r with P. 

Accordingly, it is concluded that the true equilibrium 
state may not be obtained within moderate MC steps 
when long-range interactions are substantially stronger 
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FIG. 2: Relaxation time r (in units of the MC step) near 
the critical temperature Tc, estimated from the relation 
m — rrieq ^ e~*'^^, with J2/J1 and P varied, (a) Exponen- 
tial increase of r with J2/J1 for P = 0.1, reflecting that the 
updating probability is an exponentially decreasing function 
of J2/J1. The solid line represents the best fit: r = Toe""'^^'''^ 
with To = 1.7 and a — 1.6. (b) Algebraic decrease of r with P 
for two values of J2/J1, which is related with the character- 
istic path length of the small-world network. The solid and 
dashed lines correspond to the power-law decay r = toP~'^ 
with To = 1.4; a = 1.56 and to = 2.8; a = 3.3, respectively. 

than local ones. To circumvent this problem and to ob- 
tain the equilibrium state efficiently, we propose a mod- 
ified updating method which is efficient in simulations 
of such a system. The slow relaxation originates from 
the fact that flipping a spin interacting (strongly) via a 
shortcut is hardly probable, even though the free energy 
reduces if accepted. Therefore, when a spin in a cluster 
linked via shortcuts is selected during sequential update, 
we also consider, with probability one half, the possi- 
bility of flipping all the spins in the cluster simultane- 
ously. Note that the probability of such cluster updating 
is much higher than that of usual single-spin updating be- 
cause the energy difference involves only the short-range 
interactions. Still single-spin updating is also allowed, so 
that ergodicity of the system remains intact. Further, 
the probability to be selected as a cluster is taken always 



FIG. 3: Relaxation time r (in units of the MC step) at low 
temperature Tc/2, estimated from the relation m — rrieq ~ 
e"'''^, with J2/J1 and P varied, (a) Exponential increase 
of T with J2/J1 for P — 0.1, reflecting that the updating 
probability is an exponentially decreasing function of J2/J1. 
The solid line represents the best fit: t = tqc""^'^ ^ '^'^ with 
To = 13 and a = 2.6. (b) Algebraic decrease of r with P 
for J2/J1 = 5.0. The solid line corresponds to the power-law 
decay r = toP~" with to = 0.8 and a = 7.1. 



the same for every relevant spin, which guarantees the 
detailed balance condition. The new algorithm is thus 
expected to help the system to reach the correct equilib- 
rium quickly, yielding appropriate results efficiently. 

To demonstrate the efficiency of the new algorithm, we 
employ it to probe the case of strong long-range interac- 
tions {J2/J1 ^ 5) where the conventional algorithm is 
practically inapplicable. To find the critical temperature 
at given values of P and J2/J1, we examine the scaling 
behaviors of the magnetization to, susceptibility X) spe- 
cific heat C, and Binder's cumulant Typically, we 
consider the system of size up to = 12800 and take the 
average over 100 different network realizations as well as 
the thermal average over 5 x 10"* MC steps after equili- 
bration at each temperature. 

We write the finite-size scaling forms as m = 
N-P/<'h{\t\N^/''), X = N'^'^g{\t\N^'''), and C = 
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FIG. 4: Phase diagram of the Ising model on a smaU-world 
network, where the region below each boundary represents 
the ordered phase for the corresponding value of the addition 
probability P. Simulation data for various values of P are 
depicted by symbols on lines; the latter are merely guides to 
eyes. Analytic results in Refs. 9i and 10 are also plotted, with 
the same kinds of thick and thin lines, respectively, for each 
value of P. They coincide with numerical results when P is 
small and/or J2 is sufficiently smaller than Ji. For J2/J1 
large, our data locate between the two analytic results in the 
phase diagram. 



N"'^'^ f{\t\N^^'^) with appropriate scaling functions and 
critical exponents 7, a, /3, and where t = {T — Tc)/Tc 
is the reduced temperature. Finite-size scaling analyses 
of these quantities obtained for N = 1600, 3200, 6400, 
and 12800 unanimously support a phase transition of the 
mean-field type, with exponents 7 = 1, a = 0, /9 = 1/2, 
and 9 = 2. The critical temperature turns out to agree 
well with the value obtained from the unique crossing 
point of Binder's cumulant. It is thus concluded that 
the system undergoes a finite-temperature transition of 
mean- field nature for J2/J1 > and P ^ 0. 

Here shortcut interactions are essential for the ID sys- 
tem to display long-range order. The critical temperature 
Tc/Ji is expected to increase as J2/J1 is raised. In sim- 
ulations, however, T^/ Ji does not keep increasing with 
J2/J1 beyond a certain value depending on P. In Fig. 01 
we present the phase diagram of the system with range 
/c = 1, for various values of P. In this case of fc = 1, 
analytic results have been reported for similar systems: 
A replica symmetric solution has been developed on the 
networks constructed by superimposing random graphs 
onto a one-dimensional ring 0. Subsequently, combi- 
natorics has been used to treat quenched disorder on the 
networks, where each node is restricted from having more 
than one shortcut ^3 • Those networks coincide with our 
network only in the limit P — » 0. For finite P, in con- 
trast to the latter, we allow each node to have more than 
one shortcut in the construction, which is more realis- 
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FIG. 5: Phase diagram of the Ising model on a small-world 
network with range k = 2. Simulation data for various values 
of P are depicted by symbols on lines; the latter are merely 
guides to eyes. For P > 0.3, the phase boundary intersects the 
Ji = line at a finite value of J2, manifesting the presence of 
a phase transition. This exhibits that a small-world network 
with local links deleted has a threshold value of P below which 
no long-range order emerges. 



tic and necessary for the small-world network to have 
an exponential tail in the degree distribution. Further, 
one end of each added shortcut is determined sequen- 
tially, which makes our network have less numbers of 
large-degree nodes than the former (superimposed ran- 
dom) network. Accordingly, the standard small-world 
network used in this_^studj;_jies in between the two types 
of network in Refs. 9 and 10. Since spins on those nodes 
which have more links facilitate more spins to order, the 
critical temperature of the system on the small- world net- 
work should be lower than that in Ref. ^3 E^nd higher 
that that in Ref. 0, and such difference is expected to 
grow as P and J2 are increased. It is indeed observed 
in Fig. 0] that the phase boundary of the system on the 
small- world network locates in between the boundary ob- 
tained in Ref. [l^ and that in Ref. ^ particularly in case 
that J2 is substantially larger than Ji and P is not very 
smah (P > 0.05). 

We also consider the system with range fc = 2, where 
local interactions are present between the next nearest 
neighbors as well as the nearest neighbors, and perform 
extensive simulations, the results of which are displayed 
in Fig. [51 As expected, the region of the ordered phase in 
the phase diagram is increased compared with the case 
fc = 1. Except for this, when P is small (P < 0.3), 
the overall features are entirely similar to those of the 
case fc = 1: The critical temperature increases with 
J2/J1, eventually saturating to a finite value. In case 
that P > 0.3, on the other hand, one observes an order- 
disorder transition on the Ji = line; this corresponds to 
the small-world network whose local links are all deleted 
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so that there remain only randomly added shortcuts with 
fraction P. In comparison with the case P < 0.3, where 
no ordered phase exists on this line, manifested is the per- 
colation problem in the resulting random graph. Namely, 
the system is percolating only when its connectivity, 
given by kP, is higher than 2Pc « 0.6. It is pleasing 
that this value agrees with the known expression for the 
threshold value Pc = 1 — \/ {k ~ 1)/^ J}- We have also 
performed simulations of the system with fc = 3, to ob- 
tain fully consistent results. It is of interest that the 
threshold value is smaller than that of the Erdos-Renyi 
(ER) random graph which reflects that our random 
graph is still more regular than the ER graph. 

In summary, we have studied via extensive numerical 
simulations the Ising model on a small-world network, 
where long-range interactions via shortcuts are in gen- 
eral different from local interactions. It has been demon- 
strated that long-range interactions via added shortcuts 
help spins to order, raising the critical temperature at 
first and having it saturated eventually. Of particular 
interest is the case of strong long-range interactions, rel- 
ative to the local ones, where each cluster may play the 
role of temporarily quenched randomness. The system 
then tends to be trapped in a local minimum, inhibited 
from relaxation to the global minimum (i.e., equilibrium); 
this results in very slow relaxation, making simulations 
inefficient. This is in contrast with the Ising model on 



conventional regular or disordered lattices, where severe 
inhomogeneity in the interaction strength is absent and 
equilibrium is reached quickly at all temperatures except 
in the critical region without any erratic behavior. To 
circumvent this problem, we have developed a modified 
updating algorithm, assisting the system to reach equi- 
librium quickly. Any dynamical system on a small-world 
network with strong long-range interactions is expected 
to behave similarly, and the modified algorithm devel- 
oped here may be used to obtain (equilibrium) thermo- 
dynamic properties efficiently. Finally, it would be of in- 
terest to investigate the case that long- and short-range 
interactions have opposite signs {J2/J1 < 0). The coex- 
istence of ferromagnetic and antiferromagnetic interac- 
tions in general introduces frustration into the system, 
which, together with the randomness associated with the 
long-range connections, may lead to the (truly) glassy 
behavior 1^. The detailed investigation of how such a 
glass system relaxes depending on the value J2/J1 and 
comparison with the other cases are left for further study. 
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